Digital interactive system for providing full interactivity with live programming events

ABSTRACT

The present invention relates to an interactive digital system enabling viewers full and active participation in experiencing a live broadcast event. Particularly, the presentation of the live event is personalized for the viewer through the provision of various options, including multiple video streams, associated with different c125 amera angles, for example, and integrated audio and graphics segments. Further, information obtained from related Web sites can be integrated into the live program. Various video and audio streams are collected from a live event and forwarded to a central control studio. Graphics are created at the central studio on a personal computer or chyron device. After receiving the video, audio and graphics signals, the signals are digitized and compressed in digital compressors. These signals are then combined with special data codes into a “digital package,” and subsequently, transmitted over a cable distribution system. Once received at a viewer home, the signals are received and processed in an interactive digital cable box. Selections of the video, audio, graphics displays and/or Web pages can be made as a function of immediate viewer entries, or to interrogatory responses presented at the beginning or during the program, or based on a prestored viewer profile. Once a decision is made to switch from one video to another video option, the digital switch is performed seamlessly. The digital interactive system is based upon seamless branches which occur in the course of full-motion video.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser.No.08/815,168 filed 11 Mar. 1997, which is a continuation-in-part ofapplication Ser. No. 08/598,382 filed Feb. 8, 1996 now U.S. Pat. No.5,861,881, which is a continuation-in-part of application Ser. No.08/443,607 filed May 18, 1995, now U.S. Pat. No. 5,724,091, which iscontinuation-in-part of application Ser. No. 08/166,608 filed Dec. 13,1993, now abandoned, which in turn is a continuation of application Ser.No. 07/797,298 filed Nov. 25, 1991, now abandoned, each of which arehereby incorporated herein by reference in their entirety.

BACKGROUND OF THE INVENTION

Interactive video and audio presentation systems are currently beingintroduced into the entertainment and educational industries. Aprominent interactive technology that has been applied successfully inthese industries is based on providing interactivity in a one-way systemthrough the provision of multiple time-synched parallel channels ofinformation. For example, commonly owned Freeman et al. patents, U.S.Pat. Nos. 4,264,925 and 4,264,924, which provide both audio and videointeractivity, disclose interactive television systems where switchingamong multiple broadcast or cable channels based on viewer selectionsprovides an interactive capability.

These systems have been enhanced to include memory functions usingcomputer logic and memory, where selection of system responses played tothe viewer are based on the processing and storage of subscriberresponses, as disclosed in Freeman patent, U.S. Pat. No. 4,507,680.

The benefits of providing interactivity through the use of differentaudio responses is disclosed in Freeman, U.S. Pat. Nos. 4,847,698,4,847,699 and 4,847,700. These television systems provide a common videosignal accompanied by several synchronized audio channels to providecontent related user selectable responses. The audio signals producedifferent audio responses, and in some cases, these are syllable synchedto a first audio script and to the video signal (such as to a person orcharacter on a display), providing the perception that the person's orcharacter's mouth movements match the spoken words.

Interactivity is brought to the classroom in the Freeman U.S. Pat. No.5,537,141. The distance learning system claimed in this applicationenhances the classroom educational experience through an innovative useof interactive technology over transmission independent media. When aninstructor, either broadcast live on video or displayed from videotape,asks a question, each and every student responds, preferably by enteringa response on a remote handset, and each student immediately receives adistinct and substantive audio response to his or her unique selection.The individualization of audio response from the interactive program isa major aspect of the invention.

Individualization of audio is brought to the home based on thetechnology disclosed in Freeman U.S. Pat. No. 5,585,858. This systemprovides a program that can be watched on any conventional televisionset or multimedia computer as a normal program. But if the viewer has aspecial interactive program box connected to the television, he or shecan experience a fully functional interactive program. Each interactiveviewer enjoys personalized audio responses and video graphics overlayedon the screen. The interactive program can be provided to televisionsets or to computers by cable, direct broadcast satellite, televisionbroadcast or other transmission means, and can be analog or digital.

However, what is needed is an interactive presentation system forproviding true video, audio and graphics interactivity with digitalprograms broadcast live. Such a system must efficiently package all thedigital elements of the live interactive program at a centralizedcontrol studio and allow viewers at home to receive personalizedinteractive programming.

SUMMARY OF THE INVENTION

In accordance with the invention, there is provided an interactivedigital system allowing the viewer active participation in selectingdigital video streams, associated with different camera angles, forexample, and integrated audio and/or graphics segments. Further, Webpages from Internet Web sites can be integrated into the program. Theinvention is particularly suited for the environment of live events,such as the broadcast of live sporting events. The viewer can appear todirect the camera shots by instantly changing among various cameraangles, choose player interviews, or display associated statistical dataon the team or players via graphics. In this manner, the system allowsthe individual subscriber to act as if he or she has control over howthe program is directed and presented on their personal television set.In addition to selecting different camera angles, various audio options,closeups, slow motion, replays, graphics overlays, graphics or audiofrom Web sites, etc., are all possible. Further, games can be integratedwith the live sports programming to increase viewer interest.

Thus, viewers can customize the content of programs. The interactivedigital programming of the present invention is particularlyadvantageous for viewing live sporting events. Viewers are not limitedto selecting from multiple camera angles, but may also call up playerstatistics on demand, listen to selected player interviews, etc. Camerascan be focused on different segments of an event. Further, video optionscould include video replay, slow motion effects, isolation on aparticular player or group, etc. Changes are seamless, thereby adding tothe effect that the viewer is directing the television show just as adirector now does from a control room.

This “director” role by the viewer is possible due to the interactivetechnology of the present invention and also due to the digitalcompression and transmission scheme which allows for much greaterinformation throughput over a given bandwidth, allowing viewers tochoose from angles that are already available but presently cut by thedirector.

The digital interactive system is based upon branches which occur in thecourse of the full-motion video. Branches are real-time parallel pathsthat may be other full-motion video segments, graphics which areintegrated into the video, audio segments, and/or retrieved Web pageswhich are integrated into the live event.

Sometimes, the interactive digital system will act upon the viewer'sresponse immediately; other times, it will utilize ACTV's unique“profiling” concept to act upon the response later. This technologyenables the system to “remember” the viewer's responses and desires, andintegrate them into the video, audio, graphics and/or Web siteinformation at a later point. For example, the viewer could specify atthe beginning of a football game to isolate the offensive quarterback ofa particular team. Thus, whenever the team of choice is on offense, thevideo isolation of the quarterback is displayed to the viewerautomatically. Or, based on how a viewer has selected camera angles,replays, etc., over the past five minutes, the system acts to mimicthese selections at later times during the program. The system of thepresent invention “learns” from the viewer how they want to view thegame, and thus, continues viewer selection sequences made earlier.

At the source, the present invention comprises a plurality of videocameras, each of the video cameras relaying a different predeterminedview of an event. The video signals corresponding to the differentcameras are forwarded to a central control studio. Further, one or moreaudio signals or graphic statistical overlays can be collected and sentto a central control studio. After receiving the video, audio, andgraphics signals at the central control studio, these signals aredigitized and compressed in digital video and audio compressors. Thesesignals are then combined with special data codes into a “digitalpackage,” and subsequently, transmitted over a cable distributionsystem. The special data codes are the keys to unlocking the interactivepotential of the program.

The digital program signals are transmitted to a receive site by anysuitable transmission means. Once received by a receive antenna, thedigital program signals are passed along on a digital cable televisiondistribution system to the viewer homes. Further, some other signals orcommercials can be inserted at the local head end. The signals arereceived and processed in a digital cable box. Selections of the video,audio, graphics display and/or Web pages can be made as a function ofimmediate viewer entries, or to interrogatory responses presented at thebeginning or during the program, or based on a prestored viewer profile.Once a decision is made to switch from one video option to another videooption, the digital switch is performed seamlessly.

As mentioned above, the program at predetermined times or immediatelyupon user entry can retrieve and branch to informative segments from Websites. For example, a viewer watching a sporting event, through thesystem of the present invention, can receive a stream of Web pages whichprovide additional, specific information relating to a favorite player,team or perhaps the remaining schedule for the sports team, as examples.In addition, users can take advantage of the two-way capabilities of theInternet to respond to polls or to link to additional sites.

Another Internet-based application allows advertisers to speak moredirectly to consumers by directly sending Web pages to the consumerinstead of merely displaying Web addresses in their commercials. Theparticular advertising information from Web sites can be targeted toviewers based on the viewer profile, stored either in the digital settop box or at the cable headend. Alternatively, Web site access can beinitiated by the viewer by simply clicking on the remote during thecommercial. Thus, viewers have the capability to individually select Websites if they want more information from advertisers, for example.

The video programming and corresponding Internet pages can be viewedeither on personal computers equipped with a television card on specialdigital cable boxes with stored interactive Internet applicationsoftware providing Internet access, or on digital television sets, allof which would utilize the specialized TV/Internet software of thepresent invention.

The present invention also has applications for other types ofprogramming. For example, viewers can direct the scenes of a murdermystery. Switching from one scene to another can be done seamlesslywithout noticeable effect on the viewer. Further, the present inventioncan be used for any kind of live or pre-recorded event. For instance, amusic concert or a political convention can be enhanced in the manner ofthe invention.

Accordingly, a primary objective of this invention is providing anenhanced digital live program allowing the display to be tailored to theuser's desires, choices or interests.

It is an object of this invention to personalize and enhance livesporting events for the viewer.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram of the network and equipment for providing livedigital programming.

FIG. 2 is a block diagram of an interactive digital cable box allowingseamless switching between video signals.

FIG. 3 is a block diagram of an alternative dual-tuner interactivedigital cable box allowing seamless switching between video signals.

FIG. 4 is a block diagram of another alternative interactive digitalcable box allowing seamless switching between video signals.

FIG. 5 is a time diagram showing a representation of trigger points andcorresponding video, audio and/or graphics segments, one or acombination of which are selected for presentation to the subscriberimmediately after the execution of the trigger point function.

FIG. 6 is a block diagram of an alternative embodiment of theinteractive system including Internet access.

FIG. 7 is a block diagram of the two-way configuration of the system.

DETAILED DESCRIPTION OF THE INVENTION

The present invention is an interactive digital system 1 for producing apowerful personalized program allowing the home viewer an expanded setof programming options. Digital TV streams are put into digital packagesmade up of video, audio, data codes and graphics, and are used toprovide personalized responses to viewer selections. Such responses canbe further enhanced by allowing access to Internet Web sites 170. Inthis manner, sports such as golf, football, baseball, basketball, etc.can now be watched with greater interest and involvement. However, evenfurther enhanced interactivity is possible with the present inventiondue to the provision of various profiling and memory features.

As shown in FIG. 1, the present invention begins with the gathering ofseveral possible video streams by way of cameras 100, strategicallylocated at a sporting event 10, for example. Currently, many cameras 100are employed at a sporting event 10. Super Bowl coverage, for example,typically encompasses 25 to 30 cameras. These live video streams can beintegrated with recorded video streams which, for example, could includehighlights from the current game or past games, player profiles, etc. Todescribe the components and operation of the present invention, theproduction and transmission of a live sporting event 10, i.e., football,is chosen to present the invention features. However, other applicationscan be appreciated by the reader, including several disclosed below.

A. The Control Studio

The interactive broadcast program is prepared at the control studio 5into digital packages. The control studio 5, as shown in FIG. 1, allowsa producer to create and introduce interactive elements during a livebroadcast. In one preferred embodiment, the producer pre-records a setof interrogatories or instructions for the user. These interrogatoriesmay include such questions as the following:

-   -   SELECT THE CAMERA ANGLES/OPTIONS THAT YOU PREFER:    -   OPTIONS: END-ZONE    -   FIFTY YARD LINE    -   FOCUS ON THE QUARTERBACK    -   FOCUS ON THE DEFENSE    -   FOCUS ON THE CHEERLEADERS    -   PROVIDE HIGHLIGHTS    -   WHO IS YOUR FAVORITE TEAM IN THE GAME?    -   OPTIONS: BLUE TEAM    -   RED TEAM    -   WHO IS YOUR FAVORITE PLAYER IN THE GAME?    -   OPTIONS: RED RUNNER    -   BLUE QUARTERBACK    -   BLUE DEFENSIVE END    -   RED QUARTERBACK    -   ETC.    -   ARE YOU INTERESTED IN RECEIVING STATISTICAL SUMMARIES?    -   WOULD YOU ENJOY LISTENING TO PLAYER INTERVIEWS DURING THE GAME?

Such interrogatories can be presented to the viewer at the beginning ofthe broadcast or scattered throughout the program. Interactive responsesto such interrogatories would include video, audio and graphicspersonalized to the particular viewer. The preparation of the graphicsfor presenting such interrogatories occurs off-line at the controlstudio 5 using chyron or any graphics language. These interrogatories orinstructions will ultimately be displayed to the home viewer, preferablyin the form of graphics, to facilitate the interactive responses. Theproducer creates these graphic video slides of questions on a computerusing the text editor and chyron. Associated with each question, theproducer enters a number of possible viewer options. Then, the producerrelates each possible user entry to one or more correspondinginteractive responses. If the response is information from an InternetWeb page, the producer will indicate the particular Uniform ResourceLocator (URL) of the Web page. The producer sets a time stamp for wheneach particular question will appear during the program. As explainedbelow in more detail, the viewer response to a query will be used todirect which video (and/or audio, graphics, or Web page) option will beprovided to the viewer. In the present invention, the interactiveresponse to the query can occur immediately following the entry of theviewer entry or at some predetermined later time in the program using“trigger points,” 500 as explained in detail below.

With respect to the video segments, cameras 100 are preferably trainedon different segments of the sporting event 10. As is common withbroadcasts of a football game, for example, cameras 100 could be locatedin the endzone, press box, the field and at various other locationsthroughout the stadium. Further, various video options can be createdincluding video replay, slow motion, isolation on cheerleaders,particular player or group of players. Instant replays are created bydelaying the live feed for a certain number of seconds. These videostreams are sent to a control studio 5. The control studio 5 containsthe necessary equipment for packaging the program for delivery to theviewers. The studio 5 contains a video switcher 105 which receives thelive signals from the cameras 100 by way of various input lines.Further, lines carrying recorded video streams from one or more VCRs 110, computers or CD players feed into the video switcher 105. The videoswitcher 105 also receives video inputs from the control computer 135.Further, various graphics screens, depicting, for example, sports teamor player statistics can be designed with the control personal computer135 and forwarded to the digital video switch 105. The producer, via thecontrol PC 135, directs which video options to pass through the videoswitcher 105. At the output of the video switcher 105, each of thedifferent output video streams access a separate encoder 125 and are allGENLOCKED, so that each video stream is synchronized with the othervideo streams.

After encoding, the video streams are input into a video compressor 125.Preferably, the digital compression scheme is MPEG-2. Preferably, 64Quadrature Amplitude Modulation (QAM) is used as the modulation scheme.In this digital embodiment, four channels of digitally-compressed videocontent would carry about 27 Mbps using 6 MHz of bandwidth.Alternatively, if 256 QAM is employed, seven-to-one video compressioncan be achieved with the MPEG-2 scheme. While MPEG-2 is the preferredcompression scheme, the signals can be compressed according to any knownstandard including MPEG-1, JPEG, or other DCT coding scheme, wavelets,fractals or other transform or waveform based technique.

The control studio 5 also contains an audio switcher 115 which receiveslive audio signals from microphones or recorded audio from tape players120, CDs, VCRs 110, etc. The control computer 135 sends commands to theaudio switcher 115 directing which audio options should pass through theswitch 115. Further, in the audio switcher 115 the various audio signalscan be aligned to match the various video signals in time. In addition,VCR audio output is received by the audio switcher 115. The presentinvention can accommodate any number of audio signals as output from theaudio switcher 115, as directed by the producer. The audio outputs arereceived by an digital audio encoder/compressor 130. The audio signaisare then preferably sampled, encoded and compressed in the digital audioencoder/compressor 130. The encoding technique can be a waveform codingtechnique such as PCM, ADPCM or DM. Alternatively, the signals can beencoded using synthesizer or encoder techniques such as MUSICAM, LinearPredictive Coding (LPC), Adaptive Predictive Coding (APC), and Sub-bandcoding. Generally, the transmission rate is about 256 kbps per audio forthe stereo pair.

The timing and control for integrating the various multimedia elementsis provided by the ACTV authoring language, a unique set of interactivedata codes to facilitate the interactive process. The data codes arestored in memory in the control computer 135 as part of the ACTVprogramming language. The codes comprise commands, or branch codes, forbranching between interactive options, timing signals for controllingthe interactive program, data or text, commands for termination andinitiation or interactive program viewing, or triggers for executingmacros. Preferably, these commands are output from the control computer135 and multiplexed with the video streams in the MPEG-2 compressor 125,as shown in FIG. 1. Interactive options that can be branched to based onthe branch codes include video segments, audio segments, graphicssegments and/or identified Web pages.

There are several commands in the ACTV authoring language that functionto provide the interactive sports programming applications. Thesecommands are explained below in Section D, which details programmingapplications.

B. The Transmission System

As shown in FIG. 1, the digital interactive system 1 uses an interactiveprogram delivery system with any transmission means including satellite15, cable 150, wire or television broadcast 175 to deliver theinteractive program (hereinafter “composite interactive program”) fromthe control studio 5 for distribution to subscribers in their homes. Atthe control studio 5, the signals from the digital multiplexer 140 areconverted to RF and distributed to a microwave 175, cable 150 orsatellite 15 network. Preferably, the digital interactive signal isforwarded from the control studio 5 to a cable headend 150, andsubsequently, sent to the homes via the cable network.

The program is preferably the broadcast of a live event. For example,live sporting events with added interactive elements can be broadcastfrom the control studio 5. Such live interactive elements could bedifferent camera angles 100, slow motion video, etc., as discussedabove, while also incorporating prerecorded interactive segments such ashighlights. Alternatively, the program can be produced off-line andstored in a program storage means at the control studio 5.

In a satellite broadcast transmission, the digital interactive signalsare transmitted to uplink equipment where they may be multiplexed,upconverted, modulated, amplified and transmitted by satellite 15 to thereceiver site 155 for distribution to the homes.

At the reception end, the composite digital interactive signals enter areceiver 155 where the signals are demultiplexed, downconverted,demodulated and then passed to a cable distribution system that directsthe signals to the homes. Although a cable distribution system 150 isthe preferred transmission media to the homes, the digital signals mayalso be distributed by any conventionally known technique includingsatellite 15 to digital satellite receivers 155 at the home,fiberoptics, low or high power broadcast television 175, telephonelines, cellular networks, and similar technology can be usedinterchangeably with this program delivery system.

C. The Interactive Digital Box

The interactive digital box 25 is shown schematically in FIG. 2.Preferably, the interactive digital box is a specially adapted digitalcable box 25. The controller 260 determines what video, audio, graphicsand/or Web pages to display based upon the interactive commands which itreceives. Based upon the commands, it plays the appropriate video,audio, graphics or Web page options. The graphics can either be createdand sent from the control studio 5 or the graphical images can becreated at the interactive digital box 25 based on instructionspreferably in the interactive commands. The interactive digital box 25connects to a television 165 or other display monitor. Further, theinteractive digital box 25 can be connected to a digital television 195,in which case an RF modulator 245 is not necessary. Each downstreamtransmission reaches the subscriber's house, shown in FIG. 2, preferablythrough a tap and drop cable.

The user interacts with the program through the input device 20.Preferably, the input device 20 is a typical television remote. The userinterface 270 may be an infrared, wireless, or wired receiver thatreceives information from the input device 20.

Regardless of the type of input device 20, user inputs can be utilizedby the present invention immediately, or at a later time, to result inpersonalized graphics, video and/or audio presentation. For example, thepresent invention utilizes “trigger points,” 500 as described below, toenable subsequent branches among multimedia segments during the show.

Certain commands are sent from the control studio 5 as part of thedigital interactive programming to facilitate the collection of userentries. These commands are extracted at the digital demultiplexer 210and sent to the controller 260 which performs the appropriate actionbased on the commands. Some of these commands are explained below.

a. Begin Input Extended

The Begin Input command starts an input period during which the user maypress one or more buttons to select his or her choice(s). The entryformat of this command is set forth as follows:

BEGIN INPUT {{N} {VALID KEYS} {DIFFERENT} {FEEDBACK}

where:

N The maximum number of keys that can be pressed. KEYS The valid keysthat can be pressed. DIFFERENT Requires each key pressed to bedifferent. FEEDBACK The feedback type provided to the viewer.

b. Begin Video Choice Extended

The Begin Video Choice begins an input period for disco mode. Duringdisco mode, the video switches dynamically each time the viewer makes aselection.

BEGIN_VIDEO_CHOICE MODE [KEYS] {FEEDBACK [AUDIO]}

The disco mode allows the viewer to change channels at will, while theOneShot mode allows only one change of channel.

MODEDISCO/ONESHOT

KEYS The valid keys that can be pressed.

FEEDBACK The feedback supplied to the user for the key(s) which arepressed.

The mode Disco allows the viewer to change channels at will, while theOneShot mode allows only one change of channel.

c. Begin Audio Choice Extended

The Begin Audio Choice begins an input period for disco mode.

BEGIN_AUDIO_CHOICE MODE [KEYS] {FEEDBACK [AUDIO]}

MODEDISCO/ONESHOT

KEYS The valid keys that can be pressed.

FEEDBACK The feedback supplied to the user for the key(s) which arepressed.

d. Map

The Map command is used to map video or audio tracks to keys, for use inconnection with the Begin Audio Choice and Begin Video Choice commands.If this command is omitted, Key 1 will map to Track or Channel 1, Key 2to Track or Channel 2 etc. This command allows mapping any key to anychannel.

MAP KEYS [TRACKS [T1, . . . TN/T1-TN] CHANNELS [C1, . . . CN/C1-CN]]

The map statement maps audio tracks or video channels to keys, to enableaudio or video choice commands to effect changes to tracks other thanthe default tracks, which are that key 1 maps to track 1, key 2 to track2, etc.. All the choice statements after a map statement will cause thetracks, video tracks or channels to be changed to those specified in themap statement. The acceptable numbers for the map command are from 1 to8, for keys, video channels and audio channels.

Other commands include those which allow for the following applications:(1) viewer profiling, to enable the set top box 25 to “remember” viewerpreferences; (2) uploading viewer responses to a central location; (3)downloading of text and graphics, for display using the graphics chip ofthe set top box 25; (4) the ability of the viewer to prepare his ownvideo, based upon his selections of camera shots 100 and audio, whichcan be stored and replayed for the viewer.

The interactive digital box 25 of the present invention enables seamlessflicker-free transparent switching between the digital video signals.“Seamless” means that the switch from one video signal to another isuser imperceptible. Because the video signals are running off the sameclock, the interactive digital box 25 is capable of providing a seamlessdigital switch from one video signal to another signal. The programclock reference necessary for the box to make this seamless switch ispreferably embedded in the signal header.

As shown in FIG. 2, a CPU 260 is connected to an RF demodulator 200 anddigital demultiplexer 210. The CPU 260 directs demodulation anddemultiplexing of the proper channel and data stream to obtain thecorrect video signal. Seamless switching can occur with MPEG-2compressed signals since there are points within the frame whereinseamless switching can occur. Preferably, switches occur at an “I”frame, assuming the use of MPEG-2 compression. The selected video signalis determined either by examination of the user's input from userinterface 270 and/or any other information or criteria (such as personalprofile information) stored in RAM/ROM 265. For example, the RAM/ROM 265could store commands provided within the video signals as discussed inU.S. Pat. No. 4,602,279, and incorporated herein by reference.

The RF demodulator 200 demodulates data from the broadcast channeldirected by the controller 260. After the data stream is demodulated, itpasses through a forward error correction circuit 205 into a digitaldemultiplexer 210. The demultiplexer 210 is controlled by the controller260 to provide a specific video signal out of a number of video signalswhich may be located within the data stream on the demodulated broadcastchannel. The demultiplexed video signal is then decompressed and decodedby decompressor/decoder 215. The video signal is synchronized by a syncadd circuit 220 and a sync generator 225. The video signal is thenbuffered by a video frame buffer 230. The buffered video signal ismodulated by a modulator 245 into a NTSC compatible signal. Such amodulator is not necessary if the selected signal is sent to a digitaltelevision 195.

By using a video frame buffer 230 and delaying the viewing of a givensignal, enough time is allowed for the decompressor/decoder 215 to lockonto, decompress, convert to analog, and wait for the resultant verticalinterval of a second video signal. For example, assume video signal A iscurrently being processed and transferred through the circuit shown inFIG. 2 and displayed. Based upon a user selection, the controller 260directs the digital demultiplexer 210 and RF demodulator 200 to switchto another video signal, video signal B. To accomplish this, the analogvideo from the first digital video signal, video signal A, complete withvideo sync, is fed into video frame buffer 230. This buffer 230 can holdthe full video picture for “n” number of frames after which the signalis output to the display. In effect, a delayed video signal A is viewed“n” number of frames after the signal has been received. When the userselects a different video path by means of pressing a button on a keypador entry by other means, the controller 260 instructs the digitaldemultiplexer 210 to stop decoding signal A and lock onto signal B tobegin decoding signal B instead of signal A.

While this is happening, even though the decompressor/decoder 215 is nolonger decompressing video signal A, the display is still showing videosignal A because it is being read from the buffer 230. As soon asdecompressing and decoding occurs, the controller 260 looks for the nextvertical blanking interval (VBI) and instructs the video frame buffer230 to switch to its input, rather than its buffered output at theoccurrence of the VBI.

Since the RF demodulator 200, forward error corrector 205, digitaldemultiplexer 210, and decompressor/decoder 215 require a certain timeperiod to decompress and decode the video signal B frame from its datastream, the size of the buffer 230 has to be large enough so that thisprocessing can take place without interruption during the switching ofthe video signals. If desired, the system may continue to use the bufferin anticipation of a future switch. By using the controller 260 tomanipulate the fill and empty rate of the buffer 230, the buffer 230 maybe rapidly filled with video signal B frames and then after a period oftime will be reset and ready to make another switch to another video inthe same manner. The buffer 230 may also be reset by skipping frames orproviding a delay between sequential frame outputs for a short time inorder to fill the buffer 230. If a delay is used to maintain videosignal or frame output while the buffer 230 is being filled, a slightdistortion may occur for a brief amount of time.

Because a first video signal is always displayed as the output of thebuffer 230 after the delay, the buffered video masks the acquisition anddecoding of a second video signal. As long as the buffer 230 is largeenough to keep the first video running while the second video is beingdecompressed and decoded, a seamless switch will occur.

While the digital interactive box 25 of FIG. 2 provides videointeractivity, audio and/or graphics interactivity is also provided. Forexample, if, based on the viewer profile or viewer response to query, itis determined that the viewer's primary language is Spanish, then thatviewer could obtain Spanish commentary to the football, soccer, etc.game. Alternatively, if a viewer has a favorite athlete, the audio canswitch to an interview with the athlete during a segment of thebroadcast. Multiple digital audio options forming a set of suitableresponses to an interrogatory message can be sent as part of thecomposite digital signal. As set forth in U.S. Pat. No. 5,585,858,herein incorporated by reference, there are a number of different waysto effectively forward the necessary audio options for a given liveevent to the digital interactive box 25. With the present invention, itmakes no difference how the audio options reach the digital interactivebox 25, as long as they are available for selection and play at theappropriate times.

In FIG. 2, the digital demultiplexer 210 extracts the digital audiosignal(s) and forwards them to the audio switch 250. Additional audiooptions are available from the digital audio memory 255. At certaintimes during the program, the data codes will identify the selection ofa particular audio option corresponding to previous user inputs. Thecontroller 260 calls the appropriate audio options from internal memory255 or directs the audio switch 250 to select a predetermined audiosegment received as part of the received digital signal for passage tothe RF modulator 245 for play to the subscriber. At the end of the audiosegment time period as indicated by the data codes, the controller 260instructs the audio switch 250 to again pick up standard audio.

The digital demultiplexer 210 sends the extracted graphics data or ACTVdata codes to the controller 260. The controller 260 interprets theextracted data as either control data, including instructions forswitching between video signals, audio signals, or graphics data foron-screen display. If the data is on-screen display data, the data ispreferably prefixed by a command designating the data as on-screendisplay data, as opposed to control data. Further, the controller 260also examines the control data for the occurrence of a header codedesignating the onset of a trigger point 500 in the program, explainedbelow.

FIG. 3 shows an alternate, dual tuner embodiment for seamless switchingbetween separate video signals. This embodiment presumes that two 6 MHzchannels are used, each of which comprises compressed digital video andaudio streams. In this embodiment, the microprocessor 260 controls theselection of the RF channel that is demodulated by RF demodulatois 200A,200B. The demodulated data streams enter the forward error correctors205A, 205B. At the output of the forward error correctors 205A, 205B thedata streams are transmitted to the input of the digital demultiplexers210A, 210B.

As with the RF demodulators 200A, 200B, the digital demultiplexers 210A,210B are controlled by the microprocessor 260. This configuration allowsthe microprocessor 260 to independently select two different individualtime-multiplexed video signals on different channels and data streams.If all the video signals of an interactive program were contained on asingle channel or data stream, it would only be necessary to have asingle RF demodulator 200, forward error corrector 205, and digitaldemultiplexer 210 serially connected and feeding into the two digitalvideo buffers 230A, 230B.

Two data streams are provided from the digital demultiplexers 210A,210B. One data stream carries video information pertaining to the videosignal the user is currently viewing. The second data stream carries thevideo signal selected based on the user's previous and/or currentinteractive selections from the user interface 270, as determined by themicroprocessor 260.

The digital information on each of the two streams is buffered indigital video buffers 230A, 230B. The buffered signals are thendecompressed and converted into analog signals by decompressors/decoders215A, 215B which include digital to analog converters. The decompressors215A, 215B are preferably MPEG-2 decoders.

A local sync generator 225 is connected to sync add 220A, 220B and framesync 380A, 380B circuits. Because both streams are synchronized based onsignals from the same local sync generator 225, each stream becomessynchronized to the other. In particular, the signals on each stream areframe synchronized.

A vertical blanking interval (VBI) switch 335 is connected to themicroprocessor 260 so that the input may be switched during the verticalblanking interval of the current stream, resulting in a seamless switchto the viewer.

The embodiment of FIG. 3 operates as follows. Based on user responsesand control codes, it is assumed that the microprocessor 260 determinesthat a switch from video signal A to video signal C should be performed.The RF demodulator 200A and digital demultiplexer 210A are processingthe currently viewed video signal, video signal A, which is progressingthrough the upper branch components. A command is issued from themicroprocessor 260 to the RF demodulator 200A, 200B commanding a switchto the channel and data stream on which video signal C is located. Themicroprocessor 260 also instructs the digital demultiplexer 210B toprovide video signal C from the received data stream to digital videobuffer 230B.

At this point, the upper RF demodulator 200A and digital demultiplexer210A are still independently receiving and processing video signal A,which continues through the upper branch of the circuit.

At a certain point, the digital decompressor/decoder 215B in the lowerbranch will begin filling up with video signal C frames. After videosignal C is decompressed and decoded, it is converted into analog. Alocal sync generator 225 inserts both local sync and frame sync to videosignal C via sync add circuit 220B and frame sync circuit 380B in orderto synchronize it with the currently displayed video signal A, which isstill being provided from the upper digital video buffer 230A. At theappropriate switch point, triggered by programming codes supplied witheach video signal A and C, the microprocessor 260 directs the VBI switch335 to switch in the vertical blanking interval from video A to video C,at which time video C will then seamlessly appear on the computerscreen.

Digital video buffers 230A, 230B maybe used in the circuit of FIG. 3,but are optional. However, in an alternative embodiment the bufferswould be required to provide a seamless switch if the FIG. 3 circuit wasmodified to incorporate a single RF demodulator 200, single forwarderror corrector 205, and single digital demultiplexer 210, each with asingle input and single output. In this alternative embodiment, thecircuit cannot independently receive and demultiplex two data streams ondifferent frequency channels. One buffer 230A is used to storepreviously received video signals, while the other buffer 230B quicklypasses through the selected video signals.

Based on the same assumptions above, video signal A is progressingthrough the upper branch of the circuit and it is desired to switch tovideo signal C. However, in this alternative embodiment, the digitalvideo buffer 230A is providing maximum buffering to video signal A.

Because it is desired to switch to video signal C, the microprocessor260 directs the alternative circuit (containing a single RF receiver200, single forward error corrector 205 and single digital demultiplexer210 connected in serial), to receive and demultiplex the data stream onwhich video signal C is located, which may be different than that ofvideo signal A. When video signal C is demultiplexed, the microprocessor260 directs the digital video buffer 230 to provide minimum buffering ofvideo signal C so that decompressor/decoder 215 may quickly decompressand decode the digital signals. After decompression and decoding, videosignal C is synchronized with video signal A. At this time, video signalA is read for display from digital video buffer 230A. The upper digitalvideo buffer 230A must be large enough to provide video frames foroutput during the time it takes the RF demodulator 200 and digitaldemultiplexer 210 to switch to video signal C and the time required fordecompression, decoding, and synchronization of video signal C.

When video signal C is synchronized with video signal A, themicroprocessor 260 directs VBI switch 335 to switch from video signal Ato video signal C in the vertical blanking interval of video signal A,thereby providing a seamless and flicker-free switch.

At this time, digital video buffer 230 will begin to utilize maximumbuffering by altering its fill/empty rate as described above withrespect to the FIG. 3 embodiment. When adequate buffering is achieved, aswitch to another video signal may be performed in the same manner asdescribed above.

Another preferred embodiment is shown in FIG. 4. This embodiment alsoincludes an RF demodulator 200, a forward error corrector 205, and adigital demultiplexer 210. However, the circuitry differs along the restof the chain to the television set or monitor. In this embodiment, amemory 475 is incorporated and connected to the output of thedemultiplexer for storing the compressed composite digital video signal.The decompressor/decoder 215 is inserted at the output of the compressedmemory. The decompressor/decoder 215 decompresses the digital signal,converts the signal to analog and forwards the analog signal to the RFencode 245 for transmission to the monitor. Once the compositecompressed digital video signal is fed into the compressed memory 475,the microprocessor 260 directs a pointer to be placed somewhere alongthe compressed digital video signal. Based on the placement of thepointer, different frames and different segments of the compositedigital video signal will be read from memory 475 for decompression anddecoding.

The different video signals are distinguished from one another becausethey are labeled, preferably by headers. Assuming that video signal Ahas been selected for play on the monitor, the compressed digital memory475 fills up with A frames. Assuming a switch to video signal C isdesired, the microprocessor 260 directs the RF demodulator 200 anddigital demultiplexer 210 to begin filling the compressed memory 475with video C frames. The decoder 215 pointer begins to move down. Assoon as a sufficient number of C frames have entered the compressedmemory 475, the pointer will then jump to the beginning of the C frames.The C frames are then output into the decompressor/decoder 215 where thedigital frames are converted into an analog signal.

The digital video is multiplexed in a series of easily identifiablepackets. These packets may contain full compressed frames of video (Iframes) or may include only the differences between full frames (Bframes or P frames).

To be able to reconstruct the full video images, thedecompressor/decoder 215 needs to have a minimum number of I, P and Bframes. The decoder 215 needs only one I frame to decode an image.Conversely, two prior Anchor frames (“I's” and “P's”) are necessary todecode B frames. In order to decode P frames, the decoder 215 only needsone Prior Anchor frame. When the microprocessor instructs the digitaldemultiplexer 210 to start sending packets from a different data streamthere is no way to be certain that the next packet will be an I packetneeded for decoding the second video stream. To avoid a breakup of thevideo images, which would occur if the decompressor/decoder 215 suddenlystarted receiving packets unrelated to the stream it was decoding, themicroprocessor 260 starts to fill up the memory 475 with video signal Cpackets until it is determined that a full sequence of I, B and P framesare available. The decoder 215 should receive the last bit of the last Bframe in a given, GOP (Group of Pictures) before the switch, in order toprevent glitches when decoding. Furthermore, the last B frame of the GOPmust only be backward predicted, not forward predicted or bidirectionalpredicted. As soon as the valid sequence is in memory 475 themicroprocessor 260 moves the memory read pointer to the start of a validsequence of C video signal packets so that the decompressor/decoder 215can successfully decode the C signals. This results in a seamless switchfrom video signal A to video signal C.

This embodiment requires a data channel for enabling a synchronousswitch between a first video stream and a second video stream. This datachannel comprises the ACTV codes which link together the differentprogram elements and information segments on the different videosignals. In addition, the data channel also comprises synchronizationpulses and a time code to signify to the pointer the proper time to skipfrom a memory location representing one video signal to a memorylocation representing another video signal in order to enable a seamlessswitch.

The microprocessor 260 reads the data signal from the digitaldemultiplexer 210 and communicates pertinent data to the sync addcircuit 220, which is connected to sync generator 225. Themicroprocessor 260 is then able to synchronously communicate with thememory 475.

The time code sent will identify the timing for one picture, as well asfor multiple pictures, and will lock the different pictures together.This is done through the use of similar clocks at both the transmissionend and the receiver. A time code is used in order to keep the twoclocks at both the transmission and receive end synchronously connectedto one another. Once the clocks at both ends are working synchronously,each of the multiplexed video streams must be synchronized to theclocks. In order to synchronize the multiplexed video stream to theclocks, each of the individual channels must be referenced to a commonreference point and must be identified.

In the preferred embodiment, a packet header would be incorporated intothe transport layer of the MPEG signal to identify the various channels.The packet header will also include information as to where to insertthe vertical blanking interval. In MPEG, the vertical blanking intervalis not transmitted from the headend. Therefore, the vertical blankinginterval must be generated locally. The packet header eye will identifyat what time the vertical blanking interval is in existence in order toeffectuate a seamless switch between analog pictures.

In summary, the combination of clock and the information embedded ineither the transport layer of MPEG or in a separate packet on a separatedata channel effectuates the linking between each video signal and acorresponding time point. The data channel also includes informationdesignating when all the various video signals will be in synchronismwith one another. It is at these points that the microprocessor 260 maydirect the pointer to skip from one location to another location, at atime (such as during the VBI) when a seamless switch will result.

D. Trigger Points

Interactivity is further enhanced in the digital interactive embodimentsthrough the application of trigger points 500 scattered at variouspredetermined times throughout the program, a timeline representation ofwhich is shown in FIG. 5. The trigger points 500 correspond to timeswhen interactive events are scheduled to take place during the livesporting event 10. These interactive events could be the selection andplaying of video, audio segments, the display of graphics or display ofWeb pages accessed from Internet Web sites 170. For example, when aviewer's favorite baseball player is at bat, graphics showing past orcurrent performance statistics of the player can be overlaid on thescreen while excerpts from an interview with the player can be playedfor the viewer. While the choice of particular video, audio or graphicsis still dependent on viewer selections, the viewer selections inresponse to displayed graphical interrogatory messages are preferablymade during a period at the onset of the program or when a viewer firsttunes into the program. Alternatively, interrogatories are not necessaryif the switches are based on the viewer profile stored in memory 265.These viewer selections are then utilized as inputs to macros called upat later times during the program by the controller 260 upon theoccurrence of the trigger points 500, identified to the interactivecomputer by unique codes embedded in the video signal.

The trigger points 500 correspond to the times when the conventionalprogram content can be altered and personalized for the viewers. Theprogrammer can place the trigger points 500 at any time throughout theprogram. Since the trigger points 500 are unknown to the subscriber, thesubscriber does not know when they will receive a personalized message.In other words, an interactive response can either immediately follow acorresponding user selection made to an interrogatory message or occurat a later time corresponding to a trigger point 500, or any combinationof the two. Of course, timing of the interactive events shouldcorrespond to suitable times in the program where branching tointeractive elements is sensible and does not clash with the programcontent of the conventional video still displayed on the television 165or other display monitor.

At the onset of a trigger point 500, the controller 260 will select oneof several possible audio (or video or graphic display) responses forpresentation to the subscriber. As mentioned above and shown in FIG. 5,some of the responses may comprise a branch to either a video segment,graphics and/or audio segments.

In combination with the use of trigger points 500, the present inventionallows for the viewer to select certain options at the onset of theprogram to suit the viewers' preferences. For example, if the programbroadcast is a live sports event 10, at an early trigger point 500, theviewer could be queried as to whether the viewer would prefer to receiveaudio in English, Spanish, French, or perhaps hear the local announcerinstead of the network announcer. Upon the viewer selection, the CPU 260directs a branch to the appropriate interactive segment.

Each trigger point 500 is identified preferably through the broadcast ofACTV codes sent as part of the composite interactive program signal. Thecodes preferably include, at a minimum, the following information: (1)header identifying the occurrence of a trigger point 500; (2) functionID (e.g., selection of audio or graphics responses, etc.); and (3)corresponding interrogatory message(s) or particular viewercharacteristic or habit based on viewer profile. The first bit sequencesimply identifies to the controller that a trigger point 500 is about tooccur. The function ID designates the macro or other set of executableinstructions for the controller 260 to read and interpret to obtain thedesired result, e.g., a selected video and/or audio response.

Upon extraction of the codes by the data decoder, the controller 260reads and interprets the codes and calls from memory 265 a particularuser selection(s) designated by the trigger point 500 codes. The userselections correspond to subscriber answers to a series of interrogatorymessages preferably presented at the beginning of the program. Afterobtaining the appropriate user selection(s), the controller 260 readsand performs the executable instructions using the user selection(s) asinput(s) in the macro algorithm. The result of the algorithm is either aselected video stream, audio and/or selected graphics response. Thevideo/audio response can be called from memory 265 if it is prestored,called from external data storage, or the controller 260 can command theswitch to branch to the particular video audio stream if the response isbroadcast concurrently with the trigger point 500. After the selectedvideo/audio response is played to the subscriber, the switch branchesback to the standard program, shown at time t_(s) in FIG. 5.

As mentioned above, a series of interrogatory messages are preferablypresented when the subscriber begins watching the interactive program.These interrogatory messages can be presented in any one of three ways.First, the interrogatory messages can be presented as graphics displaysoverlaid by the interactive computer workstation onto a video signal,wherein the graphics data is sent in the vertical blanking interval ofthe composite interactive signal, or alternatively stored on the harddisk or external storage. Second, the interrogatory messages arepresented as graphics displays as discussed above, except the graphicsdata comes from local storage, external data storage (e.g., CD ROM,cartridge, etc.), or a combination of data in the VBI and data calledfrom either local or external data storage. Third, graphics data can bepresented in the form of user templates stored at the interactivecomputer workstation.

User selections corresponding to answers to the n successiveinterrogatory messages are received by the remote interface 270 at thebeginning of the show, stored in memory 265 and used throughout the showat the appropriate trigger points 500 to subtlety change program contentas the show progresses. Preferably, each interrogatory has a set ofpossible answers. Next to each possible answer will be some identifiercorresponding to a label on a key on the user interface. The subscriberdepresses the key corresponding to their answer selection. Thisselection is decoded by the remote interface 270 and controller 260,stored in memory 265, preferably RAM, and used later as required by analgorithm designated at a trigger point 500.

E. Internet

In addition to the central studio serving as a source of interactiveoption responses, the Internet can be used as a source of personalizedinformation for interactive responses.

As discussed above, the video programming is preferably created at acentralized location, i.e., the control studio 5 as shown in FIG. 1, fordistribution to subscribers in their homes. Referring to FIGS. 1 and 6,in a preferred method, the operator at the control studio 5 mustdesignate certain Web pages to correspond to one of the program options,such as audio and/or graphics options, using control PC 135 and URLencoder 600. Instead of encoding the actual content of the options atthe control studio 5, as with the audio, Web address identifiers, i.e.,Uniform Resource Locators (URLs) are encoded and sent as part of thedata codes from the control PC 135 to the digital multiplexer 140. Aftermultiplexing, the URLs are sent as part of the program signal 615, asdescribed above. Preferably, the URLs, like the various audio andgraphics options, have associated time stamps which indicate to theremote digital set top boxes 25 when, during the video program, todisplay the particular Web pages addressed by the URLs, the selectionand display of which is preferably made as a function of viewerresponses or viewer profile.

Preferably, each digital set top box 25 has an Internet connection 160created concurrently with the cable connection. The Internet connection160 can be via high-speed line, RF, conventional modem. The digital settop box 25 has Internet access 160 via any of the current ASCII softwaremechanisms. In a preferred embodiment, in the interactive digital settop box 25, the digital demultiplexer 210 extracts the URLs along withthe other data codes. In an alternative embodiment, a local URL decoder605 at the user site extracts the URLs.

In a preferred embodiment, a JAVA enabled browser as well as specializedsoftware for performing part of the method of the present invention areinstalled on the interactive digital set top box 25. The JAVA enabledbrowser allows the interactive digital set top box 25 to retrieve theWeb pages and is preferred software, since it is platform independent,and thus, enables efficient and flexible transfer of programs, images,etc., over the Internet. The specialized software acts as an interfacebetween the video programming and the Internet functions of the presentinvention. The processor and software interprets these URLs and directsthe JAVA enabled browser to retrieve the particular relevant Web pages,and synchronizes the retrieved Web pages to the video content fordisplay on the television monitor 165 at the appropriate times.

In the present invention, the viewer also has the capability to link toa channel website at will. For example, if a viewer is interested inpurchasing a product described in an advertisement, by merely clickingon a button on their remote 20, the producer's Website could be accessedby Internet connection 160 and displayed to the viewer. The viewer couldthen either obtain more information about the product or order theproduct, if desired. As described above, this application is possible bysending the URL associated with the producer's Website to the digitalcable boxes 25 as part of the interactive program. Upon selection by theviewer, the web browser, located either in the digital set-top box 25 orexternally in a connected PC 610, can retrieve the Web pages. Thespecialized software then synchronizes the Web pages for video display.

F. Memory

The interactive digital set top box 25 of the present invention also hasthe advantage of remembering subscriber responses and using theseresponses in choosing a video/audio response, and/or graphicsinterrogatory message, to present to the student. Memory branching is atechnique of the present invention where the algorithm assemblesvideo/audio responses and graphics interrogatory messages according tothe current and previous user inputs. Memory branching is accomplishedby linking video/audio streams and/or successive graphics interrogatorymessages together in a logical relationship. In this scheme, theinteractive digital set top box 25 contains logic (preferably, in thesoftware algorithm) and memory 265 to store previous subscriberselections and to process these previous responses in the algorithm tocontrol future video/audio stream selection, as well as future graphicsmessage selection.

G. Digital Viewer Profiles

In a preferred embodiment, the interactive digital cable box 25 can havea “viewer profile” stored in its memory 265. Alternatively, theaccumulated profile of viewer characteristics and/or habits can bestored at the control studio 5 or cable headend. If the profilestatistics are accumulated at some central location, they can also besent to each viewer's home. On the other hand, if accumulated in memory265 at each of the set top terminals 25, the data could be sent to thecentral location for storage and dissemination by way of the digitalback channel. Decisions regarding personalized advertising and viewingcan then be made for a viewer or class of viewers based on theaccumulated parameters.

The “viewer profile” preferably contains characteristics of theparticular viewer at that subscriber location, such as sex, hobbies,interests, etc. This viewer profile is created by having the viewerrespond to a series of questions. Alternatively, the viewer profilescould be created at a control studio 5 and sent to the interactivedigital cable box 25. This information is then used by the cable boxsoftware to create a compendium of the viewer's interests andpreferences—i.e., a user profile. The stored user profile would be usedin place of the question/answer format, and thus, dictate the branchesto interactive segments of interest to the viewer.

Alternatively, the interactive cable box 25 can be programmed to createa user profile of each viewer based on the selections made during one ofthe interactive programs. If the profile shows that a particular viewerdoes not enjoy violence, the system can automatically branch to anothervideo signal at the commencement of a fight in a sports program.Furthermore, such a user profile could be modified or enriched over timebased on selections made during future interactive programs. Forexample, the ‘memory’ technique described above can be used to modifythe user profile based on user response over time.

Event data is collected from the viewer when the following command isreceived and processed by the controller 260 in the interactive digitalcable box 25:

VIEWER PROFILE

This command is used to enable events which can be utilized forprofiling during a show. The events indicated in this command are thoseprofiling events which are possible during the show. The enabled eventsmay be either selected by the viewer during the show, or may beautomatically enabled based upon viewer selections.

VIEWER_PROFILE EVENT1, . . . EVENT24

Once the profile is created, the programming choices or interactiveresponses can be triggered based on the content of the viewer profileitself. For example, if the viewer profile suggests that the viewer isparticularly interested in sports cars, a sports car commercial could beplayed for the viewer at a predetermined point in the program. Asanother application, if a viewer's profile indicates that the viewer isinterested in cooking, whenever the viewer watches such a program, theuser profile would trigger the interactive program to download recipesand either display such recipes on the screen or send the recipes to anattached printer.

Viewer profile information can then be collected at the control studio 5through polling of the viewer cable boxes 25 for viewer selection data.Special polling software is loaded into the digital set top box 25 forperforming the polling functions. Alternatively, the invention allowsfor the digital set top boxes 25 to send back data on command from thecontrol studio 5 or periodically. The command to initiate an upload ofviewer profile data is as follows:

UPLOAD EXTENDED

This command is used to initiate the uploading of data to the centralsite.

UPLOAD_EXTENDED UPLOAD_IDENTIFIER VARIABLE_NAME

[PHONE_NUMBER]

UPLOAD_IDENTIFIERnumeric constant identifying upload.

VARIABLE_NAME name of variable to be uploaded

PHONE_NUMBER string, that consists of numbers only. it can be omitted,if not needed.

Regardless of whether a polling or periodic scheme is used, thestatistics and other user profile information is preferably sent back tothe control studio 5 by use of the back-channel.

H. Applications

The embodiments, described above, allow for several possibleapplications. For example, in a live sports event 10, one channel couldcarry the standard video channel, with other channels carrying differentcamera angles 100 and/or close-ups of particular players. Otherpotential video options include instant replay, highlights, playerstatistics via graphic overlays, etc. Graphics presenting statisticalinformation on the players can be constantly updated using the Chyronsystem.

The provision of trigger points 500, explained above, can provide forseamless integration of such video options during the sporting event,based on either the viewer responses to interrogatories at the beginningof the program and/or on the digital viewer profile.

Further, the viewer can become the director with the present invention.For example, the viewer can choose which camera angles 100 to emphasize.In a broadcast of golf, the viewer can direct whether they desire tofollow a particular player from hole-to-hole, focus on one particularlydifficult hole. In this manner, the viewer can customize the sportingbroadcast to meet his own interests.

Further, the viewer can act as a director to create their own video.During a live concert 10, for example, the viewer selects various cameraangles 100 at different times. These selections along with a time stamp,indicating the program time when each selection was made, are stored inmemory 265. When the program is played back a second time, the processor260 will automatically direct branching between the video channelsaccording to the stored selections at the time stamp. In this manner, amusic video can be created by the viewer.

The viewing experience can be further enlightening for the viewer byimplementing games and contests during the live sporting event 10. Forexample, graphics overlays can be developed that query the viewer duringthe game. During a football broadcast, for example, viewers can bequeried with such interrogatories as the following:

What will be the next play? (RUN/PASS/KICK);

Will the offense get the first down?;

Will they score on this possession?;

Pick the halftime score;

Who will win?

Each viewer's responses can be sent back to the control studio 5 fortabulation of scores. Preferably, the responses are packaged at thedigital cable box 25 and transmitted to the control studio 5 via thedigital backchannel upon the UPLOAD EXTENDED command. Alternatively,tabulation of scores can take place at the digital cable box 25 throughthe utilization of certain software in memory 265. Each correct answercan correspond to a certain number of points. At the end of the game,the interactive program preferably presents a graphic showing the viewerpoint total. If desired, advertisers could present special giftcertificates for excellent performance in such games. The provision ofsuch certificates would occur by displaying a certain code that a viewercan take to a store to receive the gift. In this manner, viewerinterests in sports events can be enhanced.

Further, the viewer has the option with the present invention to blockout viewing of certain events. For example, if the viewer is adverse toviolence during a sporting event or other type program, the system canblock out such options from the viewer with the following data commands:

EVENT

This command is used to indicate occurrence of a certain event (e.g., afight breaking out during a football game).

EVENT EVENT_NUMBER

EVENT_NUMBER is a numeric constant.

ON EVENT EXECUTE MACRO

This command is used to implement certain actions (such as an automaticbranch to another video channel in order to block out violent event, forexample), as soon as the event arrives.

ON_EVENT EVENT_NUMBER MACRO_NUMBER

EVENT_NUMBER is a numeric constant.

MACRO_NUMBER is a numeric constant.

I. Two-Way Configuration

The live programming system of the present invention may be operated ina two way configuration, as illustrated in FIG. 7. In this mode, thevarious video signals are processed as previously described, beingdigitized and compressed at the control studio 5. The signals are thensent to a central switching station, or headend 30.

In this embodiment, the switching between the various live digitalsignals is accomplished at the headend 30 rather than at the receiver.On the receive end, each digital set-top box 760 relays viewerselections back to the remotely located switching station 30.Preferably, the viewer selections are relayed by way of the digital backchannel 770. However, the viewer selections may be relayed to theswitching station 30 by any conventional means, such as two-way cabletelevision, telephone or microwave transmission. The switching station30 receives the viewer selection and routes the desired signal to atransmitter 750 which conventionally transmits the desired video downthe appropriate digital cable channel for the particular viewer.

At the central switching station 30, a demultiplexer 710 demultiplexesthe compressed signals and places each on a separate bus channel 725. Anumber of remote control interactive switches 730, 732, 734, 736 areconnected to the video signal bus 725. Based on the viewer selections,an algorithm stored in memory 265 and under processor 260 control at thecentral switching station 30, a digital seamless switch is made and theselected video, audio and/or graphics are forwarded to the viewer homefor display.

Such a two-way embodiment could be implemented in a video dial tone orvideo server system. In such a system, only a single video channel 755is necessary for each home. Once the viewer selection is received at theserver site at the cable headend 30, a switch is made to the appropriatevideo stream and this stream is sent on the single channel 755 to thehome.

Alternatively, it may be desirable to transmit an interactive sportingevent over a single telephone line. When the viewer enters a selectionon their remote 20, a signal is sent by way of the telephone line to thecentral switching station 30 which routes the desired signal of theinteractive program over the user's telephone line so that a single linkhandles both the interactive choice being made at the receiver and thetransmission of that choice from the headend 30 where the actualswitching takes place in response to the interactive selection made atthe receiver.

The two-way link between the viewer and switching station 30 may be usedfor other purposes. For example, demographic data may be transferredfrom the viewer to the broadcast network for commercial purposes, suchas targeted advertising, billing, or other commercial or non-commercialpurposes.

While the present invention has been described primarily with respect tolive events, and in particular sporting events, it has equal potentialfor enhancing content in other program categories. A viewer can becometheir own director of a murder mystery or other drama. By enteringresponses to displayed questions at the initiation of or during theshow, the program will branch to alternative video/audio segments as aresult of the user selections. In this manner, different viewers withdifferent selections may end up with a different murderer at theconclusion of the broadcast.

Using the foregoing embodiments, methods and processes, the interactivemultimedia computer maximizes personalized attention and interactivityto subscribers in their homes in real time. Although the presentinvention has been described in detail with respect to certainembodiments and examples, variations and modifications exist which arewithin the scope of the present invention as defined in the followingclaims.

1. A television reception system for receiving live interactiveprogramming, the live interactive programming comprising a plurality ofdigitally compressed video signals, the video signals further comprisingat least a first video signal and a second video signal, the receptionsystem comprising: a tuner that receives and tunes a transmission signalcarrying the plurality of video signals from a plurality of videocameras providing differentiable views of a live event, the tunerincluding a demodulator that demodulates the plurality of video signalsas directed by a microprocessor; an audio switcher that receives anaudio signal associated with the live event; a forward error correctionunit that detects redundant data in the transmitted video signals andcorrects errors in the transmitted video signals; a demultiplexor thatdemultiplexes the plurality of video signals to obtain a first videosignal, and that extracts graphics data and control data from theplurality of video signals, and that demultiplexes the audio signal; adecompressor/decoder connected to the demultiplexor that decompressesand decodes the first video signal the extracted graphics data andcontrol data; a video synchronizer that receives the decompressed anddecoded first video signal and the extracted graphics data and controldata and synchronizes the decompressed and decoded first video signaland the extracted graphics data and control data; a video frame bufferthat holds the synchronized first video signal for a number of framesand delays output of the synchronized first video signal to allow thedecompressor/decoder lock onto and decompress the second video signaland to wait for a vertical interval of the second video signal; a viewerinterface for receiving a viewer entry; the microprocessor, connected tothe viewer interface and the decompressor/decoder and the demodulator,the microprocessor directing demodulation of the demodulator anddirecting operation of the demultiplexor to perform a seamless switchfrom the first video signal to the second video signal in response to atleast one of the received viewer entry and a control code; wherein thedecompressor/decoder further decompresses and decodes the demultiplexedsecond video signal; and the microprocessor coordinates thedecompressing and decoding of the first video signal, the holding of thefirst video signal in the video frame buffer by manipulating the filland empty rate of the video frame buffer, and the decompressing anddecoding of the second video signal such that the switch from the firstvideo signal to the second video signal is imperceptible to a viewer asthe first video signal is displayed as an output of the video framebuffer after the delay thereby masking the acquisition and decoding ofthe second video signal; and a means for displaying the first videosignal and the second video signal.
 2. A television reception system forreceiving live interactive programming, the live interactive programmingcomprising a plurality of digitally compressed video signals, the videosignals further comprising at least a first video signal and a secondvideo signal, the reception system comprising: a tuner that receives andtunes a transmission signal carrying the plurality of video signals froma plurality of video cameras providing differentiable views of a liveevent, the tuner including a demodulator that demodulates the pluralityof video signals directed by a microprocessor; an audio switcher thatreceives an audio signal associated with the live event; a forward errorcorrection unit that detects redundant data in the transmitted videosignals and corrects errors in the transmitted video signals; ademultiplexor that demultiplexes the plurality of video signals toobtain a first video signal, and that extracts graphics data and controldata from the plurality of video signals, and that demultiplexes theaudio signal; a decompressor/decoder connected to the demultiplexor thatdecompresses and decodes the first video signal and the extractedgraphics data and control data; a video synchronizer that receives thedecompressed and decoded first video signal and the extracted graphicsdata and control data and synchronizes the decompressed and decodedfirst video signal and the extracted graphics data and control data; avideo frame buffer that holds the synchronized first video signal for anumber of frames and delays output the synchronized first video signalto allow the decompressor/decoder to lock onto and decompress the secondvideo signal and to wait for a vertical interval of the second videosignal; a memory for storing a viewer profile; the microprocessor,connected to the memory and the decompressor/decoder and thedemodulator, the microprocessor directing demodulation of thedemodulator and directing operation of the demultiplexor to perform aseamless switch from the first video signal to the second video signalin response to at least one of the stored viewer profile and a controlcode; wherein the decompressor/decoder further decompresses and decodesthe demultiplexed second video signal; and the microprocessorcoordinates the decompressing and decoding of the first video signal,the holding of the first video signal in the video frame buffer bymanipulating the fill and empty rate of the video frame buffer, and thedecompressing and decoding of the second video signal such that theswitch from the first video signal to the second video signal isimperceptible to a viewer as the first video signal is displayed as anoutput of the video frame buffer after the delay thereby masking theacquisition and decoding of the second video signal; and a means fordisplaying the first video signal and the second video signal.
 3. Thetelevision reception system as set forth in claim 1 or 2, wherein: thelive interactive programming further comprises at least one digitallycompressed audio signal; the transmission signal further carries the atleast one audio signal; the demultiplexor is provided further fordemultiplexing the at least one audio signal; the decompressor/decoderis provided further for decompressing and decoding the at least oneaudio signal; and the television reception system further comprises ameans for playing the at least one audio signal.
 4. The televisionreception system as set forth in claim 3, wherein the at least one audiosignal further comprises at least a first audio signal and a secondaudio signal; the microprocessor is provided further for directing aswitch from the first audio signal to the second audio signal inresponse to at least one of a viewer input and the control code, whereinthe microprocessor coordinates the decompressing and decoding of thefirst audio signal and the second audio signal.
 5. The televisionreception system as set forth in claim 3, wherein the at least one audiosignal is associated with at least one of the plurality of videosignals.
 6. The television reception system as set forth in claim 1 or2, wherein the live interactive programming further comprises: agraphics signal; the transmission signal further comprises the graphicssignal; the demultiplexor is provided further for demultiplexing thegraphics signal; the decompressor/decoder is provided further fordecompressing and decoding the graphics signal; and the means fordisplaying further comprises a means for displaying the graphics signal.7. The television reception system as set forth in claim 1, wherein thelive interactive programming further comprises an interrogatory, whichrequests the viewer to provide a response; and the viewer entrycomprises the response to at least one interrogatory.
 8. The televisionreception system as set forth in claim 7, wherein the response comprisesa selection of one of the plurality of video signals for display.
 9. Thetelevision reception system as set forth in claim 2 further comprising aviewer interface for receiving a viewer entry, and wherein the liveinteractive programming further comprises an interrogatory, whichrequests the viewer to provide a response; and the viewer entrycomprises a response to at least one interrogatory, which response isstored in the memory as part of the viewer profile.
 10. The televisionreception system as set forth in claim 1 or 2, wherein each of theplurality of digitally compressed video signals corresponds,respectively, to one of a plurality of different predetermined cameraangles of a live event.
 11. The television reception system as set forthin claim 1 or 2, wherein the transmission signal is carried over atleast one of the transmission mediums selected from a group comprising:a satellite transmission system; a cable distribution system; abroadcast transmission system; the Internet; a private network; anin-stadium network.
 12. The television reception system as set forth inclaim 1 or 2, wherein the live interactive programming further comprisesthe control code; the transmission signal further carries the controlcode; the demultiplexor is provided further for demultiplexing thecontrol code; and the decompressor/decoder is provided further fordecompressing and decoding the control code.
 13. The televisionreception system as set forth in claim 1 or 2, wherein the plurality ofdigitally compressed video signals are compressed based upon apredicated video frame compression scheme.
 14. The television receptionsystem as set forth in claim 1 or 2, wherein: the live interactiveprogramming further comprises an encoded information segment address,which specifies the location of an information segment; the transmissionsignal further carries the encoded information segment address; thedemultiplexor is provided further for demultiplexing the encodedinformation segment address; and the decompressor/decoder is providedfurther for decompressing and decoding the encoded information segmentaddress; and wherein the system further comprises a means for retrievingthe information segment located at the information segment address; andthe means for displaying displays the information segment simultaneouslywith or in replacement of the first video signal or the second videosignal.
 15. The television reception system as set forth in claim 14,wherein the information segment address is a uniform resource locator.16. The television reception system as set forth in claim 14, whereinthe information segment address specifies an entry in a database indexaccessible via a communication network.
 17. The system as set forth inclaim 1 or 2, wherein at least one of the plurality of video signalsfurther comprises an encoded information segment address, whichspecifies the location of an information segment; and wherein the systemfurther comprises a means for retrieving the information segment locatedat the information segment address; and the means for displayingdisplays the information segment simultaneously with or in replacementof the first video signal or the second video signal.
 18. The televisionreception system as set forth in claim 17, wherein the informationsegment address is a uniform resource locator.
 19. The televisionreception system as set forth in claim 17, wherein the informationsegment address specifies an entry in a database index accessible via acommunication network.
 20. A live interactive digital presentationsystem, said live interactive digital presentation system comprising: ameans for receiving live interactive programming from a digital programstream, the live interactive programming comprising a plurality ofdigital video signals from a plurality of video cameras providingdifferentiable views of a live event, the means for receiving includingmeans for demodulating the digital program stream to obtain videosignals as directed by a microprocessor, the video signals furthercomprising at least a first video signal and a second video signal; anaudio switcher that receives an audio signal associated with the liveevent; a forward error correction unit that detects redundant data inthe transmitted video signals and corrects errors in the transmittedvideo signals; a demultiplexor that demultiplexes the plurality of videosignals to obtain a first video signal, and that extracts graphics dataand control data from the plurality of video signals, and thatdemultiplexes the audio signal; a decompressor/decoder connected to thedemultiplexor that decompresses and decodes the first video signal andthe extracted graphics data and control data; a video synchronizer thatreceives the decompressed and decoded first video signal and theextracted graphics data and control data and synchronizes thedecompressed and decoded first video signal and the extracted graphicsdata and control data; a video frame buffer that holds the synchronizedfirst video signal for a number of frames and delays output of thesynchronized first video signal to allow the decompressor/decoder tolock onto and decompress the second video signal and to wait for avertical interval of the second video signal; a viewer interface forreceiving a viewer entry; the microprocessor, connected to the viewerinterface and the means for receiving and the means for demodulating thedigital program stream, the microprocessor directing demodulation of thedigital program stream and directing operation of the demultiplexor toperform a seamless switch from the first video signal to the secondvideo signal in response to at least one of the received viewer entryand a control code; wherein, the decompressor/decoder furtherdecompresses and decodes the demultiplexed second video signal: and themicroprocessor coordinates the decompressing and decoding of the firstvideo signal, the holding of the first video signal in the video framebuffer by manipulating the fill and empty rate of the video framebuffer, and the decompressing and decoding of the second video signalsuch that the switch from the first video signal to the second videosignal is imperceptible to a viewer as the first video signal isdisplayed as an output of the video frame buffer after the delay therebymasking the acquisition and decoding of the second video signal; and ameans for displaying the first video signal and the second video signal.21. The interactive digital presentation system as set forth in claim20, wherein the live interactive programming further comprises at leastone digital audio signal; and the system further comprises a means forplaying the at least one digital audio signal.
 22. The interactivedigital presentation system as set forth in claim 21, wherein the atleast one digital audio signal further comprises at least a first audiosignal and a second audio signal; and the microprocessor is providedfurther for directing a switch from the first audio signal to the secondaudio signal in response to at least one of the received viewer entryand the control code.
 23. The interactive digital presentation system asset forth in claim 20, wherein the live interactive programming furthercomprises a graphics signal; and the means for displaying furthercomprises a means for displaying the graphics signal.
 24. Theinteractive digital presentation system as set forth in claim 20,wherein the digital program stream is received by the means forreceiving over a transmission medium selected from a group comprising:satellite transmission system; a cable distribution system; a broadcasttransmission system; the Internet; a private network; an in stadiumnetwork.
 25. The interactive digital presentation system as set forth inclaim 20, wherein the system is embodied within a computer workstation.26. The interactive digital presentation system as set forth in claim20, wherein each of the plurality of digital video signals corresponds,respectively, to one of a plurality of different predetermined cameraangles of a live event.
 27. The interactive digital presentation systemas set forth in claim 20, wherein one of the plurality of digital videosignals corresponds to a main program video feed.
 28. The interactivedigital presentation system as set forth in claim 21, wherein the atleast one digital audio signal comprises a plurality of digital audiosignals; and each of the plurality of digital video signals corresponds,respectively, to one of the plurality of digital audio signals.
 29. Theinteractive digital presentation system as set forth in claim 20 furthercomprising: a means for decoding, connected to the means for receiving,an encoded information segment address, wherein the live interactiveprogramming further comprises encoded information segment address, andthe information segment address specifies the location of an informationsegment; and a means for retrieving, connected to the means fordecoding, the information segment located at the information segmentaddress; and wherein the means for displaying displays the informationsegment simultaneously with or in replacement of the first video signalor the second video signal.
 30. The interactive digital presentationsystem as set forth in claim 29, wherein the information segment addresscomprises a uniform resource locator.
 31. The interactive digitalpresentation system as set forth in claim 29, wherein the informationsegment address specifies an entry in a database index accessible via acommunication network.
 32. The interactive digital presentation systemas set forth in claim 29, wherein the information segment address isencoded in a portion of at least one of the plurality of video signals.33. A method for providing live interactive digital programming, thelive interactive digital programming comprising a plurality of digitallycompressed, multiplexed video signals, the plurality of video signalsfurther comprising a first video signal and a second video signal, themethod comprising: receiving the live interactive digital programmingfrom a plurality of video cameras providing differentiable views of alive event into a demodulator; demodulating the plurality of videosignals as directed by a microprocessor; forward error correcting theplurality of demodulated video signals; demultiplexing the plurality ofdemodulated video signals to create a first time-multiplexed videosignal and a second time-multiplexed video signal on separate channelsand to extract graphics data and control data from the plurality ofdemodulated video signals; decompressing and decoding, in adecompressor/decoder device, the demultiplexed first and secondtime-multiplexed video signals and the extracted graphics data andcontrol data from the plurality of demodulated video signals;synchronizing the decompressed and decoded first video signal and theextracted graphics data and control data; buffering the synchronizedfirst video signal for a number of frames and delaying the output of thesynchronized first video signal; presenting the decompressed first videosignal to a viewer; obtaining a viewer input; selecting the second videosignal based on the viewer input; commanding a demodulator to switchfrom the first video signal to the second video signal; inserting alocal sync and a frame sync to the second video signal to synchronizethe second video signal with the first video signal; directing aseamless switch during a vertical blanking interval of the first videosignal to select the second video signal and select a second audiosignal, whereby the buffering of the first video signal is the result ofmanipulating a fill and an empty rate of a video frame buffer, and thedecompressing, decoding, and demodulation of the second video signal issuch that the switch from the first video signal to the second videosignal is imperceptible to a viewer; and presenting the second videosignal to the viewer.
 34. The method for providing live interactivedigital programming as set forth in claim 33, said method furthercomprising: obtaining viewer specific information; creating a viewerprofile with the viewer specific information; and wherein the step ofselecting is further based, at least in part, on the viewer profile. 35.The method for providing live interactive digital programming as setforth in claim 34, said method further comprising: storing the viewerprofile in a database.
 36. The method for providing live interactivedigital programming as set forth in claim 34, wherein the obtainingviewer specific information further comprises: presenting aninterrogatory to the viewer, wherein the interrogatory requests theviewer to select a desired programming option; collecting a response tothe interrogatory from the viewer wherein the response comprises theviewer input.
 37. The method for providing live interactive digitalprogramming as set forth in claim 33, 34, or 36, wherein the selectingis further based, at least in part, upon a control code.
 38. The methodfor providing live interactive digital programming as set forth in claim37, wherein live interactive digital programming further comprises thecontrol code.
 39. The method for providing live interactive digitalprogramming as set forth in claim 33, wherein: the live interactivedigital programming further comprises at least one digital audio signal;the step of demultiplexing further comprises demultiplexing the digitalaudio signal; and the step of decompressing further comprisesdecompressing the demultiplexed digital audio signal; and wherein themethod further comprises presenting the digital audio signal to aviewer.
 40. The method for providing live interactive digitalprogramming as set forth in claim 39, wherein: the at least one digitalaudio signal further comprises at least a first audio signal and asecond audio signal; the step of selecting is further based, at least inpart, upon a control code; and the method further comprises switchingfrom the first audio signal to the second audio signal in response to atleast one of the viewer input and the control code.
 41. The method forproviding live interactive digital programming as set forth in claim 33,wherein: the live interactive digital programming further comprises agraphics signal; the step of demultiplexing further comprisesdemultiplexing the graphics signal; and the step of decompressingfurther comprises decompressing the demultiplexed graphics signal; andwherein the method further comprises presenting the graphics signal to aviewer.
 42. The method for providing live interactive digitalprogramming as set forth in claim 33, wherein the live interactivedigital programming further comprises an information segment address,and the method further comprises: decoding the information segmentaddress; and retrieving the related information segment at theinformation segment address.
 43. The method for providing liveinteractive digital programming as set forth in claim 42, wherein theinformation segment address comprises a uniform resource locator. 44.The system method for providing live interactive digital programming asset forth in claim 42, wherein the information segment address specifiesan entry in a database index accessible via a communication network. 45.A method for providing live interactive digital programming, the liveinteractive digital programming comprising a plurality of digitallycompressed, multiplexed video signals, the plurality of video signalsfurther comprising a first video signal and a second video signal, themethod comprising: receiving the live interactive digital programminginto a demodulator to create demodulated video signals; forward errorcorrecting the demodulated video signals; demultiplexing the demodulatedvideo signals to create a time-multiplexed first video signal; storingthe time-multiplexed first video signal in a memory to create acomposite first video signal; directing a pointer at a segment of thecomposite first video signal in said memory; decompressing the segmentof the composite first video signal to create a decompressed first videosegment; forwarding the decompressed first video segment to a displaydevice; obtaining a viewer input; selecting the second video signalbased on the viewer input; directing a demodulator to switch from thefirst video signal to the second video signal; instructing ademultiplexor to provide the second video signal to the memory; fillingthe memory with frames from the second video signal; moving the pointerto a beginning frame of the second video signal; outputting the framesof the second video signal from the memory to a decompressor;multiplexing the decompressed frames from the second video signal intoidentifiable packets sending codes that link program elements andinformation segments of the first video signal and the second videosignal; synchronizing the second video signal to the first video signal;directing a synchronous switch between the first video during a verticalblanking interval of the first video signal to select the second videosignal and a second audio signal, whereby the switch from the firstvideo signal to the second video signal is imperceptible to a viewer;and presenting the second video signal to the viewer.